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H" 1 ' Abstract 

< 

Q\ ' Given an undirected graph G, the Minimum Sum Coloring problem (MSCP) is to 

find a legal assignment of colors (represented by natural numbers) to each vertex of 
G such that the total sum of the colors assigned to the vertices is minimized. This 
paper presents a memetic algorithm for MSCP based on a tabu search procedure 
with two neighborhoods and a multi-parent crossover operator. Experiments on a set 
of 77 well-known DIMACS and COLOR 2002-2004 benchmark instances show that 
the proposed algorithm achieves highly competitive results in comparison with five 
state-of-the-art algorithms. In particular, the proposed algorithm can improve the 
best known results for 17 instances. We also provide upper bounds for 18 additional 
instances for the first time. 
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^ ' 1 Introduction 



Let G = (V, E) be a simple undirected graph (without loops) with vertex set 
V = {vi, . . . , v n } and edge set E C V x V. A proper fc-coloring c of G is a 
mapping c: V — > {1, . . . ,k} such that c(vi) ^ c(vj) W{v iy Vj} £ E. A legal or 
proper fc-coloring can also be defined as a partition of V into k independent 
sets or stables Vi, . . . ,Vk such that Vit, v £ Vi (i = 1, . . . , k), {u, v} <£ E. The 
classical graph coloring problem (GCP) aims at finding a proper /c-coloring 
with k minimum. 

This paper is dedicated to the NP-hard Minimum Sum Coloring Problem 
(MSCP) pfT2] . which is closely related to GCP. The objective of MSCP is 
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to find a proper /c-coloring which minimizes the sum of the colors assigned 
to the vertices. This minimum is the chromatic sum E(G) of G: S(G) = 
min cG c/(c), with C the set of all proper /c-colorings of G (for all possible k 
values) and f(c) = Y%=i c ( v i) > or f( c ) — Z)?=i^|^| equivalently (where \Vi\ is 
the cardinality of Vi), the "coloring sum" of the proper /c-coloring c. MSCP 
applications include VLSI design, scheduling, and resource allocation [T6] . 



Considering the theoretical intractability of MSCP, a number of heuristic al- 
gorithms have been proposed to find suboptimal solutions, such as a parallel 
genetic algorithm [TU], two greedy heuristics [13], a tabu search metaheuristic 
[2], a hybrid algorithm (HA) [I], an effective heuristic algorithm (EXSCOL) 
|21j . a local search heuristic (MDS5) [8], and a breakout local search (BLS) 
P]. To our knowledge, EXSCOL, HA, MDS5, and BLS are the state-of-the- 
art algorithms in the literature. EXSCOL is based on extracting large disjoint 
independent sets and is particular effective for handling large graphs (with 
at least 500 vertices). HA is a hybrid algorithm which combines a genetic 
algorithm with a surrogate constraint heuristic. MDS5 is based on variable 
neighborhood search and iterated local search. BLS combines local search 
with adaptive perturbation mechanisms to ensure the quality of solutions. 

This paper introduces a Memetic Algorithm for the minimum Sum Color- 
ing problem (MASC), which relies on three key components. First, a double- 
neighborhood tabu search procedure is especially designed for MSCP (DNTS). 
DNTS is based on a token-ring application of two complementary neighbor- 
hoods to explore the search space and a perturbation strategy to escape from 
local optima. Second, a multi-parent crossover operator is used for solution 
recombination. Basically, it tries to transmit large color classes from the par- 
ents to the offspring. Finally, a population updating mechanism is devised to 
determine how the offspring solution is inserted into the population. 

We evaluate the performance of MASC on 77 well-known graphs from DI- 
MACS and COLOR 2002-2004 graph coloring competitions (59 of them have 
been used previously for evaluating sum coloring algorithms). The computa- 
tional results show that MASC can frequently match the best known results 
in the literature for most of the 59 cases. In particular, it improves the previ- 
ous best solution for 17 graphs for which an upper bound is known. For the 
additional 18 new graphs, we report computational results for the first time. 

The paper is organized as follows. Next section describes the general frame- 
work and the components of our MASC memetic algorithm, including the 
population initialization, the crossover operator and the double-neighborhood 
tabu search procedure. Detailed computational results and comparisons with 
five state-of-the-art algorithms are presented in Section [3j Before concluding, 
Section H] investigates and analyzes two key issues of the proposed memetic 
algorithm. 



2 MASC: A Memetic Algorithm for Minimum Sum Coloring 



A memetic algorithm is a population-based approach where the traditional 
mutation operator is replaced by a local search procedure [T8fT9] . Memetic 
algorithms are among the most powerful paradigms for solving NP-hard com- 
binatorial optimization problems. In particular, they have been successfully 
applied to the tightly related GCP [5lfT4TiTll20] . 

Our MASC algorithm is summarized in Algorithm [TJ After population initial- 
ization, MASC repeats a series of generations (limited to M axGeneration) to 
explore the search space which is defined by the set of all proper /c-colorings 
(k is not a fixed value, Section [27TT) . At each generation, two or more parents 
are selected at random (line 6) and used by the dedicated crossover operator 
to generate an offspring solution (line 7, Section |2~U]) . The offspring solution is 
then improved by a double neighborhood tabu search (line 8, Section |2~~4~]) . If 
the improved offspring has a better sum of colors, it is then used to update the 
current best solution found so far (lines 9-10). Finally, the population updat- 
ing criterion decides whether the improved offspring will replace one existing 
individual of the population or not (line 12, Section [23]) . 

Algorithm 1 An overview of the MASC memetic algorithm for MSCP 
1: input: A graph G 

2: output: The minimum sum coloring c* found and its objectif /(c*) 
3: Population_Initialization(P, p) /* Population P has p solutions, Sect. [2T2l */ 
4: /* <— min ce p /(c) /* /* records the best objective value found so far */ 
5: for i <— 1 to MaxGeneration do 

6: P' <— Selection(P) /* Select 2 or more parents at random for crossover */ 
7: o <— Crossover(P') /* Crossover to get an offspring solution, Sect. 12.31 */ 
8: o <- DNTS(o) /* Improve o with the DNTS procedure, Sect. I274T 7 
9: if f(o) < /* then 

10: /* «- f(o);c* <- o 

11: end if 

12: Population_Updating(P, o) /* Sect. [23]*/ 

13: end for 

14: return /*,c* 



2. 1 Search Space and Evaluation Function 



The search space explored by MASC is the set C of all proper /c-colorings of G 
(k is not fixed) . For a given proper /c-coloring c, its quality is directly assessed 
by the sum of colors f(c) = J2 v ev c ( v ) = Sf=i l\Vi\- 



2.2 Initial Population 



Our algorithm begins with a population P of p feasible colorings. This popula- 
tion can be obtained by any graph coloring algorithm that is able to generate 
different proper colorings for a graph. In our case, we employ the well-known 
TABUCOL [9], more precisely its improved version introduced in [5]. For a 
given graph G, TABUCOL tries to find a proper /c-coloring with k as small as 
possible. Given the stochastic nature of TABUCOL, we run it multiple times 
to obtain different /c-colorings (k may take different values). Each resulting 
fc-coloring is inserted into P if it is not already present (discarded otherwise). 
This process is repeated until P is filled with p different /c-colorings. 



2.3 Crossover Operator 



The crossover operator is an important component in a population-based algo- 
rithm. It is used to generate one or more new offspring individuals to discover 
new promising search areas. 

MASC uses a multi-parent crossover operator, called MGPX, which is similar 
to the one introduced in [7] as a variant of the well-known GPX crossover first 
proposed in [SJ for GCP (restricted to two parents). MGPX generates only one 
offspring solution o from a parents randomly chosen from P, where a varies 
from 2 to 4 according to \V\ and the best fc-coloring found for GCP (see Eq. 
[T|). Motivations for these a values can be found in [20] . 



a 



2, if \V\/k<5 

3, if 5< \V\/k< 15 (1) 

4, otherwise 



MGPX is summarized in Algorithm [2j It builds the color classes of the o off- 
spring one by one, transmitting as many vertices as possible from the parents 
at each step (for quality purpose) (lines 7-14). Once a parent has been used 
for transmitting an entire color class to o, the parent is not considered for 
a few steps with the purpose of varying the origins of the color classes of o 
(line 15). This strategy avoids transmitting always from the same parent and 
introduces some diversity in o [14] . Note that the offspring solution is always 
a proper k coloring while the number of colors used by the offspring can be 
higher than those of the considered parents. 



Algorithm 2 Pseudo-code of the MGPX combination operator 

1: input: A set P' of a parents randomly chosen from P 

2: output: An offspring o 

3: v <— /* Counts the number of colored vertices in o * / 

4: k 4— /* Counts the number of colors used in o * j 

5: (fj 4— Mcj G P' /* To identify which parents are forbidden for color k */ 

6: while v < \V\ do 

7: k <— K + 1 

8: P K <— {cj € P' : tpj < k} /* Set of parents allowed for color k */ 

9: Let Vi be a color class of maximum cardinality Vcj G P K 
10: i/<-i/+|V?| 
11: for all v G V? do 
12: o(u) <- as 

13: Remove v from Cj Vcj G P' 

14: end for 

15: ifj -h- k + L"/2J /* Forbid using c^ G P' for a few steps */ 
16: end while 
17: return o 



S.^ ^4 Double-Neighborhood Tabu Search for Sum Coloring 



Local optimization is another important element within a memetic algorithm. 
In our case, its role is to improve as far as possible the quality (i.e., the 
sum of colors) of a given solution returned by the MGPX crossover operator. 
This is achieved by a Double-Neighborhood Tabu Search (DNTS) procedure 
specifically designed for MSCP (see Algorithm |3]). 

DNTS uses two different and complementary neighborhoods N± and A^ 2 which 
are applied in a token-ring way [3fl~5] to find good local optima (intensification) 
(lines 2-14). More precisely, we start our search with one neighborhood (lines 6- 
9) and when the search ends with its best local optimum, we switch to the other 
neighborhood to continue the search while using the last local optimum as the 
starting point (lines 10-13). When this second search terminates, we switch 
again to the first neighborhood and so on. DNTS continues the exploration of 
each neighborhood A^j (z = 1,2) until Pi {i = 1,2) consecutive iterations fail 
to update the best solution found. 

This neighborhood-based intensification phase terminates if the best local op- 
timum is not updated for p 3 consecutive iterations (line 14). At this point, 
we enter into a diversification phase by triggering a perturbation to escape 
from the local optimum (line 15, Section T2.4.4p . The DNTS procedure stops 
when a maximum number of iterations p^ is met. We explain below the two 
neighborhoods, the tabu list management and the perturbation mechanism. 



Algorithm 3 Pseudo-code of double- neighbor hood tabu search for MSCP 

1: Input: Graph G, a /c-coloring c 

2: Output: the best improved /c-coloring 

3: c* i— c 

4: while a stop condition is not met do 

5: repeat 

6: c i- TS(iVi,c) /* Tabu search with neighborhood Ni, Sect. 12.4.11 */ 

7: if /(c) < /(c) then 

8: c* <- c 

9: end if 

10: c «- JS{N 2 , c) /* Tabu search with neighborhood N 2 , Sect. I2A21 */ 

11: if /(c) < /(c) then 

12: c* ^— c 

13: end if 

14: until c* not improved for j>3 consecutive iterations 
15: c «— Perturbation(c*) /* Search is stagnating, generate a new starting solution 

by perturbing the best /c-coloring found so far, Sect. 12.4.41 */ 
16: end while 



2.4.1 N-\_: A Neighborhood Based on Connected Components 



The first neighborhood N\ can be described by the operator Exchange(i,j). 
Given a proper /c-coloring c = {VI, . . . , V&}, operator Exchange^, j), (1 < i ^ 
j < k) swaps some vertices of a color class Vi against some connected vertices 
of another color class Vj. Formally, let Gij(c) be the set of all connected 
components of more than one vertex in the subgraph of G induced by color 
classes Vi and Vj in a proper /c-coloring c. In Figure [1] (left) for instance, 
Gij(c) is composed of two graphs (say gi and g 2 ) : g± is the subgraph induced 
by {v 2 , v 3 , v 6 , v 7 , v 8 } and g 2 is induced by {v 4 , v 5 , v 9 }. 





A proper /c-coloring c 



A possible d e iVi(c) 



Fig. 1. Ni m . An illustrative example with two partial colorings (c and c' are restricted 
here to two Vi and Vj color classes) 

Neighborhood Ni(c) is composed of the set Q(c) of all possible elements in 
all the Gij(c) sets: Q(c) = Ui<i<j<kGi,j(c)- In other words, Ni(c) includes all 



the proper fc-colorings that can be obtained from the current ^-coloring c by 
exchanging the vertices of a connected component induced by color classes Vi 
and Vj. Figured] shows an example where by exchanging the two sets of vertices 
{^2, ^3} and {vq, v 7, v$} of connected component gy of the current fc-coloring c 
(left drawing), we obtain a neighboring fc-coloring c' (right drawing). 



2.4-2 N 2 : A Neighborhood Based on One-Vertex-Move 

The second neighborhood N 2 is conventional and is simpler than N±. N 2 can 
be described by the operator OneMove(v,i,j). Given a proper /c-coloring c = 
{Vi, . . . , Vfc}, operator OneMove(v,i,j), (1 < i ^ j < k) displaces one single 
vertex v of a color class Vi to another color class Vj such that the resulting 
/c-coloring remains proper. For instance, from the current coloring c of the 
left drawing of Figure dj moving vertex v\ from Vj to Vj gives a neighboring 
solution. Neighborhood N 2 (c) is composed of all the possible proper /c-colorings 
by applying OneMove(v,i,j) to the current /c-coloring c. Like neighborhood 
Ni, the solutions of this second neighborhood are also proper /c-colorings. 
Moreover, the number of colors of the neighboring solutions remains the same 
as that of the current coloring. 



2-4-3 Neighborhood Examination and Tabu List 

DNTS applies these two neighborhoods Ni and N 2 in a token-ring way [3HS]- 
The alternation between N\ and N 2 is triggered when the current neighbor- 
hood is exhausted, i.e., when the current best solution cannot be further im- 
proved for a fixed number of consecutive iterations. 

During the exploration of a neighborhood, DNTS uses a tabu list [6] to avoid 
short-term cycles. Precisely, for the neighborhood Ni defined by the operator 
Exchange(i,j), when a set of vertices of a color class V, are exchanged with a 
set of vertices of another color class Vj , exchanges between Vi and Vj are for- 
bidden for the next TT iterations (called tabu tenure). For the neighborhood 
N 2 defined by the operator OneMove(v, i,j), when a vertex v of a color class 
Vi is displaced to another color class Vj, the vertex v is forbidden to go back 
to Vi for the next TT iterations. 

In both cases, the tabu tenure TT is determined simply by taking a random 
number from {0, ...k — 1}. Moreover, a forbidden Exchange or OneMove 
operation is always accepted if it leads to a neighboring solution better than 
the best solution found so far (this is called aspiration according to the tabu 
search terminology). 

As shown in Algorithm [3] at each iteration of our DNTS, a best neighboring 
solution is selected among all the allowed solutions (from Ni or N 2 ) to replace 



the current solution. The tabu list is updated accordingly after each iteration. 



2.4.4 The Perturbation Mechanism 

In addition to the basic diversification mechanism of the tabu list, our DNTS 
algorithm applies a stronger diversification strategy based on perturbations 
to escape deep local optima. The perturbation is triggered when the current 
intensification phase cannot update the recorded best solution c* for p 3 consec- 
utive iterations (see line 15, Algorithm |3]). In this case, the search is considered 
to be trapped in a deep local optimum and a strong diversification is needed to 
bring the search to a new search region. To achieve this, we apply the follow- 
ing perturbation technique to modify the recorded best solution c* and then 
use this perturbed solution to initialize DNTS. Suppose c* is composed of k 
different color classes and let V\ be the largest color class. We introduce an 
additional color class Vk+\ and then move randomly one third of the vertices 
of Vi into Vk+\. In order to prevent the subsequent search from coming back 
to c*, V\ and Vk+i are classified tabu and cannot take part of an Exchange or 
a OneMove operation for the next TT iterations (see Section f2.4.3j) . 



2.5 Population Updating 



The management of the population usually controls and balances two impor- 
tant factors in population-based heuristics: Quality and diversity. 

Quality can naturally be measured here using the coloring sum function (/). 
The proper /c-coloring c, is better than Cj if /(cj) < f(cj). 

We use the following distance H to estimate the diversity. Given two coloring 
Ci and Cj, Hij is the number of vertices in q and Cj which have different 
colors: H it j = \{v E V : Ci(v) ^ Cj(v)}\. A small H it j value indicates a high 
similarity between Cj and Cj . H is also employed to measure how much diversity 
H iP a particular /c-coloring q contributes to the entire population P: H iP = 
min j^ Hi j. Again, a small (large) H iP value indicates that Cj adds a low 
(high) diversity to P. 

In MASC, / and H are combined in a s "score" function which is used to decide 
whether an offspring solution o replaces an individual in the population P or 
not: s(ci) = f(ci) + e om \ v " Hi > p Vq G P. Precisely we first add o into P and 
compute all s(q). We then identify the worse configuration c w (i.e., s(c w ) is 
maximum). The replacement strategy applies the following rules: 

Case 1 (c,„ is not o): Remove c,„ from P; 



Case 2 (c w is o): Remove the second worse individual from P with probability 
0.2, and discard o otherwise. 



3 Experimental Results 



Our MASC approach was tested on a benchmark composed of 77 well-known 
graphs commonly used to report computational results for MSCP: 39 are 
part of the COLOR 2002-2004 competitions and the 38 others are known 
as "DIMACS" instances. Most of these graphs are available on-line from 
http://mat.gsia.cmu.edu/C0L0R04] except the 6 "flat" instances that can 



be retrieved from http://mat.gsia.cmu.edu/C0L0R/instances.html The 



main characteristics of each graph appear in Tables [2] and \5\ see columns 1-4 
(COLOR 2002-2004 instances are at the top of Tableland DIMACS instances 
at the bottom): Name of the graph, order (|V|), size (|-E|), and chromatic sum 
E (or the best known upper bound when E is unknown). 

MASC is programmed in C++ and compiled using GNU gcc on a PC with 2.7 
GHz CPU and 4 Gb RAM. Like many memetic algorithms, we use a small pop- 
ulation of 10 individuals. The values of the other parameters were determined 
empirically, see Table [TJ Notice that MaxGenerations = 50 is the stop condi- 
tion that determines the running time of the algorithm. The best results of our 



MASC algorithm will be made available at http://www.info.univ-angers.fr/pub/hao/masumcol.html 



Table 1 

Settings of parameters 



Parameter Sect. Description Value 



Pi 


El 


P2 


IO 


P3 


\2A\ 


Pi 


EU 


MaxGenerations 


[231 



Maximum number of non-improving moves for TS using N\ 500 

Maximum number of non-improving moves for TS using N2 1 000 

Maximum number of non-improving moves of TS for perturbation 4000 

Maximum iterations of TS procedure 10 000 

Maximum number of generations 50 



3. 1 Computational Results 

Columns 6-10 in Table |2] present detailed computational results of our MASC 
algorithm: Best result obtained (£*) with the number of required colors (fc*), 
success rate (SR, percentage of runs such that £*<£), average coloring sum 
(Avg.), standard deviation (a), and average running time to reach E* (t, in 
minutes). Column k shows the chromatic number or its best upper bound 
(i.e., the smallest number of colors for which a /c-coloring is ever reported). 
Furthermore, a sign "-" in column 4 (E) indicates that the instance was never 
tested in literature for the sum coloring problem (there are 18 such cases). The 



reported values are based on 30 independent runs (i.e., with different random 
seeds) . 

From Table El one observes that for the 25 cases of 39 COLOR 2002-2004 in- 
stances with known upper bounds (see top part of the table), MASC improves 
the best known upper bound for one instance (miles500) and equals the best 
known results for the other 24 graphs. For the remaining 14 cases, we provide 
upper bounds for the first time. Furthermore, MASC achieves robust results 
here since SR = 1.0 and a = 0.0 for these graphs except two instances (homer 
and queen9.9). The average running time of MASC ranges from less than one 
second to about 13 minutes except for the homer instance. 

For the set of 24 DIMACS instances (bottom part), the MASC algorithm 
improves the best known upper bound for 4 graphs (DSJC250.9, flat300_28_0, 
le450_15c, and le450_15d) and equals the best known results for 6 instances. 
Unfortunately, MASC was unable to reach the best known results for the 
other 10 graphs (see lines where SR = 0.0). For the four graphs which were 
not tested previously, we report upper bounds achieved for the first time. The 
average running time is less than 76 minutes except for the DSJC500.5 and 
flat300_28_0 instances. Finally, we notice that the number of colors needed to 
ensure the best sum coloring (&*) can be larger than the chromatic number or 
its best upper bound (k). 



3.2 Comparisons With State-of-the-art Algorithms 



Table [3] compares MASC with 5 recent effective algorithms that cover the best 
known results for the considered benchmark: EXSCOL [21], BLS pQ, MDS5 
[8], MRLF [13], and HA [I]. No averaged value appears in the table for HA, 
MDS5, and MRLF since this information is not given in |4"f8~fT3] . Furthermore, 
"-" marks signal that some instances were not tested by some approaches. 



Since the reference algorithms give only results for a (small) subset of the 
considered benchmark, it is difficult to analyze the performance of these al- 
gorithms by statistical tests. Hence, we compare the performance between 
MASC and these reference algorithms one by one and summarize the compar- 
isons in Table HJ The first column of Table H] indicates the name of the reference 
heuristics, followed by the number j^G of graphs tested by each algorithm and 
shown in Table [3J The last three columns give the number of times MASC 
reports a better, equal, or worse result compared to each reference algorithm. 

From Table IH it can be observed that MASC obtains absolutely no worse 
results than MDS5, MRLF, and HA (see the last three lines). Furthermore, 
MASC gets better results than these algorithms for 9, 16, and 10 instances 
respectively. Our algorithm is also quite competitive with EXSCOL and BLS 
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Table 2 

Detailed computational results of MASC on the set of 39 COLOR 2002-2004 in- 
stances (upper part) and 24 DIMACS instances (bottom part) 



Characteristics of the graphs 






MA 


sc 






Name 


\v\ 


\E\ 


£ 


k 


£*(fc, 


SR 


Avg. 


a 


t 


myciel3 
myciel4 
myciel5 
myciel6 
mycicl7 


11 
23 
17 
95 

191 


20 

71 

236 

755 

2 360 


21 

15 

93 

189 

381 


4 
5 
6 
7 
8 


21(4 

45(5 

93(6 

189(7 

381(8 


1.0 
1.0 
1.0 
1.0 
1.0 


21.0 

45.0 

93.0 

189.0 

381.0 


0.0 

0.0 
0.0 
0.0 
0.0 


0.0 

0.0 
0.0 
0.1 

1.1 


anna 


138 


986 


276 


11 


276(11 


1.0 


276.0 


0.0 


0.1 


david 


87 


812 


237 


11 


237(11 


1.0 


237.0 


0.0 


0.1 


huck 


74 


602 


243 


11 


243(11 


1.0 


243.0 


0.0 


0.0 


jean 
homer 


80 
561 


508 
1629 


217 


10 
10 


217(10 
1123(12 


1.0 
1.0 


217.0 
1 136.2 


0.0 

5.8 


0.0 
80.6 


queen5.5 
queen6.6 
quccn7.7 
queen8.8 


25 
36 
19 
64 


160 

290 
176 
728 


75 
138 
196 
291 


5 
7 
7 
9 


75(5 
138(8 
196(7 
291(9 


1.0 
1.0 
1.0 
1.0 


75.0 
138.0 
196.0 
291.0 


0.0 
0.0 
0.0 
0.0 


0.0 

1.1 

0.0 

12.8 


queen9.9 


81 


2112 


- 


10 


409(10 


0.3 


410.5 


1.2 


1.2 


queen8.12 
gamesl20 
miles250 


96 
120 

128 


1368 
638 
387 


443 
325 


12 
9 
8 


624(12 

443(9 

325(8 


1.0 
1.0 
1.0 


624.0 
443.0 
325.0 


0.0 
0.0 
0.0 


0.0 
0.5 
0,1 


miles500 


128 


1170 


< 709 


20 


705(20 


1.0 


705.0 


0.0 


1.0 


fpsol2.i.l 
fpsol2.i.2 


496 

151 


11654 
8 691 


3 403 


65 
30 


3 403(65 
1668(30 


1.0 
1.0 


3 403.0 
1 668.0 


0.0 
0.0 


8.7 
5.7 


fpsol2.i.3 


425 


8 688 


- 


30 


1636(30 


1.0 


1 636.0 


0.0 


7.0 


mug88.1 


88 


146 


178 


1 


178(4 


1.0 


178.0 


0.0 


0.1 


mug88_25 


88 


116 


178 


1 


178(4 


1.0 


178.0 


0.0 


0.2 


muglOO.l 


100 


166 


202 


1 


202(4 


1.0 


202.0 


0.0 


0.2 


mugl00_25 


100 


166 


202 


1 


202(4 


1.0 


202.0 


0.0 


0.3 


2-Inscrtions_3 


37 


72 


62 


1 


62(4 


1.0 


62.0 


0.0 


0.0 


3-Insertions_3 
inithx.i.l 


56 
864 


110 
18 707 


92 


1 
51 


92(4 
3 676(54 


1.0 
1.0 


92.0 
3 676.0 


0.0 
0.0 


0.0 
7.6 


inithx.i.2 


645 


13 979 


- 


31 


2 050(31 


1.0 


2 050.0 


0.0 


1.1 


inithx.i.3 


621 


13 969 


- 


31 


1986(31 


1.0 


1986.0 


0.0 


1.8 


mulsol.i.l 


197 


3 925 


- 


19 


1957(49 


1.0 


1957.0 


0.0 


0.1 


mulsol.i.2 


188 


3 885 


- 


31 


1 191(31 


1.0 


1191.0 


0.0 


0.2 


mulsol.i.3 


181 


3 916 


- 


31 


1 187(31 


1.0 


1 187.0 


0.0 


0.2 


mulsol.i.4 


185 


3 946 


- 


31 


1 189(31 


1.0 


1 189.0 


0.0 


0.2 


mulsol.i.5 


186 


3 973 


- 


31 


1160(31 


1.0 


1 160.0 


0.0 


0.2 


zeroin.i.l 


211 


4100 


- 


19 


1822(49 


1.0 


1822.0 


0.0 


0.2 


zeroin.i.2 


211 


3 541 


1004 


30 


1 004(30 


1.0 


1004.0 


0.0 


0.1 


zcroin.i.3 


206 


3 540 


998 


30 


998(30 


1.0 


998.0 


0.0 


0.1 


DSJC125.1 


125 


736 


326 


5 


326(7 


0.7 


326.6 


0.9 


4.4 


DSJC125.5 


125 


3 891 


1012 


17 


1012(18 


0.1 


1020.0 


3.9 


3.5 


DSJC125.9 
DSJC250.1 


125 
250 


6 961 
3 218 


2 503 
973 


11 

8 


2 503(44 
974(9 


0.5 
0.0 


2 508.0 
990.5 


5.6 
8.3 


1.9 
17.3 


DSJC250.5 


250 


15 668 


3 219 


28 


3 230(31 


0.0 


3 253.7 


14.3 


23.1 


DSJC250.9 


250 


27 897 


< 8 286 


72 


8 280(74 


0.1 


8 322.7 


22.3 


5.6 


DSJC500.1 


500 


12 458 


2850 


12 


2 940(14 


0.0 


3 013.4 


28.3 


50.4 


DSJC500.5 


500 


62 624 


10 910 


18 


11101(53 


0.0 


11303.5 


73.9 


202.5 


DSJC500.9 


500 


112 437 


29 912 


126 


29 994(126 


0.0 


30059.1 


31.6 


90.9 


flat300.20.0 
flat300.26.0 


300 
300 


21375 
21633 


3150 
3 966 


20 
26 


3 150(20 
3 966(26 


1.0 
1.0 


3150.0 
3 966.0 


0.0 

0.0 


0.0 

0.8 


flat300_28.0 


300 


21695 


< 4 282 


28 


4 238(30 


0.1 


4 313.4 


22.3 


309.7 


le450.5a 


450 


5 714 


- 


5 


1350(5 


1.0 


1350.0 


0.0 


0.7 


le450.5b 


150 


5 734 


- 


5 


1350(5 


1.0 


1350.0 


0.0 


0.1 


le450.5c 


450 


9 803 


- 


5 


1350(5 


1.0 


1350.0 


0.0 


0.2 


le450.5d 


450 


9 757 


- 


5 


1350(5 


1.0 


1350.0 


0.0 


0.5 


le450.15a 
le450.15b 


450 
450 


8168 
8169 


2 632 
2 642 


15 
15 


2 706(19 
2 724(19 


0.0 
0.0 


2 742.6 
2 756.2 


13.8 
14.8 


41.3 
40.3 


le450.15c 


450 


16 680 


< 3 866 


15 


3 491(16 


1.0 


3 491.0 


0.0 


45.3 


le450.15d 


450 


16 750 


< 3 921 


15 


3 506(17 


1.0 


3511.8 


3.6 


59.8 


le450.25a 


450 


8 260 


3153 


25 


3 166(27 


0.0 


3176.8 


1.1 


39.2 


le450.25b 
le450.25c 
le450.25d 


150 
450 
450 


8 263 
17343 

17 425 


3 366 

4 515 

4 544 


25 
25 
25 


3 366(26 

4 700(31 
4 722(29 


0.1 
0.0 
0.0 


3 375.1 

4 773.3 
4 805.7 


3.4 
25.2 

27.4 


40.3 
75.3 
63.4 
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Table 3 

Comparisons of MASC with five state-of-the-art sum coloring algorithms 



Graph 




EXSCOL [ST] 


BLS [JJ 


MDS5 [8] 


MRLF 03] 


HA g] 


£» 


\SC 


Name 


£ 


£* 


Avg. 


£» 


Avg. 


Avg. 


mycicl3 


21 


21 


21.0 


21 


21.0 


21 


21 


21 


21 


21.0 


mycicl4 


15 


15 


45.0 


15 


45.0 


15 


15 


15 


15 


45.0 


mycicl5 


93 


93 


93.0 


93 


93.0 


93 


93 


93 


93 


93.0 


mycicl6 


189 


189 


189.0 


189 


196.6 


189 


189 


189 


189 


189.0 


mycicl7 


381 


381 


381.0 


381 


393.8 


381 


381 


381 


381 


381.0 


anna 


276 


283 


283.2 


276 


276.0 


276 


277 


- 


276 


276.0 


david 


237 


237 


238.1 


237 


237.0 


237 


211 


- 


237 


237.0 


huck 


243 


243 


243.8 


213 


243.0 


243 


244 


213 


243 


243.0 


jean 


217 


217 


217.3 


217 


217.0 


217 


217 


- 


217 


217.0 


qucen5.5 


75 


75 


75.0 


75 


75.0 


75 


75 


- 


75 


75.0 


qucen6.6 


138 


150 


150.0 


138 


138.0 


138 


138 


138 


138 


138.0 


qucen7.7 


196 


196 


196.0 


196 


196.0 


196 


196 


- 


196 


196.0 


quecn8.8 


291 


291 


291.0 


291 


291.0 


291 


303 


- 


291 


291.0 


gamesl20 


443 


443 


447.9 


113 


443.0 


443 


446 


446 


113 


443.0 


miles250 


325 


328 


333.0 


327 


328.8 


325 


334 


343 


325 


325.0 


miles500 


< 709 


709 


714.5 


710 


713.3 


712 


715 


755 


705 


705.0 


fpsol2.i.l 


3 403 


- 


- 


- 


- 


3 403 


- 


3 405 


3 403 


3 403.0 


mug88.1 


178 


- 


- 


- 


- 


178 


- 


190 


178 


178.0 


mug88.25 


178 


- 


- 


- 


- 


178 


- 


187 


178 


178.0 


muglOO.l 


202 


- 


- 


- 


- 


202 


- 


211 


202 


202.0 


mugl00.25 


202 


- 


- 


- 


- 


202 


- 


214 


202 


202.0 


2-Inscrtions_3 


62 


- 


- 


- 


- 


62 


- 


62 


62 


62.0 


3-Insertions_3 


92 


- 


- 


- 


- 


92 


- 


92 


92 


92.0 


zeroin.i.2 


1004 


- 


- 


- 


- 


1004 


- 


1013 


1004 


1004.0 


zeroin.i.3 


998 


- 


- 


- 


- 


998 


- 


1007 


998 


998.0 


DSJC125.1 


326 


326 


326.7 


326 


326.9 


326 


352 


- 


326 


326.6 


DSJC125.5 


1012 


1017 


1019.7 


1012 


1012.9 


1015 


1141 


- 


1012 


1020.0 


DSJC125.9 


2 503 


2 512 


2 512.0 


2 503 


2 503.0 


2 511 


2 653 


- 


2 503 


2 508.0 


DSJC250.1 


973 


985 


985.0 


973 


982.5 


977 


1068 


- 


974 


990.5 


DSJC250.5 


3 219 


3 246 


3 253.9 


3 219 


3 248.5 


3 281 


3 658 


- 


3 230 


3 253.7 


DSJC250.9 


< 8 286 


8 286 


8 288.8 


8 290 


8 316.0 


8412 


8 942 


- 


8 280 


8 322.7 


DSJC500.1 


2 850 


2 850 


2 857.4 


2 882 


2 942.9 


2 951 


3 229 


- 


2 940 


3 013.4 


DSJC500.5 


10 910 


10 910 


10 918.2 


11187 


11326.3 


11717 


12 717 


- 


11101 


11303.5 


DSJC500.9 


29 912 


29 912 


29 936.2 


30 097 


30 259.2 


30 872 


32 703 


- 


29 994 


30 059.1 


flat300-20.0 


3150 


3150 


3150.0 


- 


- 


- 


- 


- 


3150 


3150.0 


flat300-26.0 


3 966 


3 966 


3 966.0 


- 


- 


- 


- 


- 


3 966 


3 966.0 


flat300.28.0 


< 4 282 


4 282 


4 286.1 


- 


- 


- 


- 


- 


4 238 


4 313.4 


le450_15a 


2 632 


2 632 


2 641.9 


- 


- 


- 


- 


- 


2 706 


2 742.6 


le450.15b 


2 642 


2 642 


2 643.4 


- 


- 


- 


- 


- 


2 724 


2 756.2 


le450.15c 


< 3 866 


3 866 


3 868.9 


- 


- 


- 


- 


- 


3 491 


3 491.0 


lc450.15d 


< 3 921 


3 921 


3 928.5 


- 


- 


- 


- 


- 


3 506 


3 511.8 


le450_25a 


3153 


3153 


3159.4 


- 


- 


- 


- 


- 


3166 


3176.8 


le450.25b 


3 366 


3 366 


3 371.9 


- 


- 


- 


- 


- 


3 366 


3 375.1 


le450.25c 


4 515 


4 515 


4 525.4 


- 


- 


- 


- 


- 


4 700 


4 773.3 


le450.25d 


4 544 


4 544 


4 550.0 


- 


- 


- 


- 


- 


4 722 


4 805.7 
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Table 4 

MASC vs. five state-of-the-art sum coloring algorithms 



Competitor 


#G 


Results of MASC 


(E.) 


Better 


Equal 


Worse 


EXSCOL [21] 


36 


12 


16 


8 


BLS [J 


25 


5 


17 


3 


MDS5 [8] 


34 


9 


25 





MRLF [S] 


25 


16 


9 





HA g] 


19 


10 


9 






which are the most recent and effective methods since it obtains better or 
equivalent results for 28 and 22 graphs respectively. MASC reaches worse 
results than EXSCOL and BLS only for 8 and 3 graphs respectively. 



3.3 Experiment on Large Graphs 



We turn now our attention to the performance of our MASC algorithm to 
color large graphs with at least 500 vertices. These large graphs are known to 
be quite difficult for almost all the existing sum coloring approaches except 
EXSCOL which dominates the other heuristics particularly on large graphs. 
We show a new experiment with MACS applied to color 17 large graphs. In 
this experiment, we run MASC 10 times on each graph under exactly the 
same condition as in Section 13.11 The only difference is that we use the so- 
lution of EXSCOll 1 ! as one of MASC's 10 initial solutions while the 9 other 
initial solutions are generated according to the procedure described in Section 
12.21 With this experiment, we aimed to investigate two interesting questions. 
Is it possible for MASC to improve the results of the powerful EXSCOL algo- 
rithm? Does the initial population influence the performance of MASC? The 
computational outcomes of this experiment are provided in Table [5J 

In Table [5], column 4 presents the best known result (£) in the literature, 
columns 5-6 present the best result (£*) and the average coloring sum (Avg.) 
of EXSCOL and columns 7-11 present detailed computational results of our 
MASC algorithm: Best result obtained (E*) with the number of required colors 
(k*), average coloring sum (Avg.), standard deviation (a), and average running 
time to reach £* (£, in minutes). One notices that the values of columns 4 and 5 
are identical. This is because EXSCOL is the single approach in the literature 
able to attain these results. 

Table[5]shows that with the help of its search mechanism, our MASC algorithm 
is able to further improve the best known results of 12 instances (entries in 
bold). This is remarkable given that no previous approach can even equal these 



Available at http://www.info.univ-angers.fr/pub/hao/exscol.html 
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Table 5 

Results of MASC on 17 large graphs with at least 500 vertices 



Characteristics of the graph 


s 


EXSCOL 




MASC 






Name 


\v\ 


\E\ 


£ 


s, 


Avg. 


k 


E.(fc.) 


Avg. 


u 


t 


DSJC500.1 


500 


12 458 


2 850 


2 850 


2 857.4 


12 


2 841(14) 


2 844.1 


3.2 


28.9 


DSJC500.5 


500 


62 624 


10 910 


10 910 


10 918.2 


48 


10897(51) 


10 905.8 


4.6 


73.3 


DSJC500.9 


500 


112 437 


29 912 


29 912 


29 936.2 


126 


28 896(131) 


29 907.8 


5.8 


59.0 


DSJC1000.1 


1000 


49 629 


9 003 


9 003 


9 017.9 


20 


8 995(22) 


9 000.5 


3.0 


70.7 


DSJC1000.5 


1000 


249 826 


37 598 


37598 


37 673.8 


83 


37 594(87) 


37 597.6 


1.2 


200.4 


DSJC1000.9 


1000 


449 449 


103 464 


103 464 


103 531.0 


223 


103 464(231) 


103 464.0 


0.0 


125.9 


flatl000_50-0 


1000 


245 000 


25 500 


25 500 


25 500.0 


50 


25 500(50) 


25 500.0 


0.0 


0.1 


flatl000-60_0 


1000 


245 830 


30100 


30100 


30 100.0 


60 


30 100(60) 


30100.0 


0.0 


114.6 


flatl000-76-0 


1000 


246 708 


37167 


37167 


37 213.2 


82 


37167 (85) 


37167.0 


0.0 


1.1 


latin_sqr_10 


900 


307350 


42 223 


42 223 


42 392.7 


98 


41444(100) 


41481.5 


19.1 


101.2 


wap05 


905 


43 081 


13 680 


13 680 


13 718.4 


50 


13669(51) 


13 677.8 


3.7 


3.3 


wap06 


947 


43 571 


13 778 


13 778 


13 830.9 


46 


13 776(48) 


13 777.8 


0.6 


4.1 


wap07 


1809 


103 368 


28 629 


28 629 


28 663.8 


46 


28617(50) 


28 624.7 


3.8 


12.4 


wap08 


1870 


104 176 


28 896 


28 896 


28 946.0 


15 


28 885(50) 


28 890.9 


3.2 


15.1 


qg.ordcr30 


900 


26100 


13 950 


13 950 


13 950.0 


30 


12 581(31) 


12 641.3 


45.7 


4.2 


qg.order40 


1600 


62 400 


32 800 


32 800 


32 800.0 


10 


32 800(40) 


32 800.0 


0.0 


11.8 


qg.order60 


3 600 


212 400 


110 925 


110 925 


110 993.0 


60 


109 800(60) 


109 800.0 


0.0 


290.6 



results. Moreover, if we contrast the results of the three DSJC500.X graphs 
(x = 1,5,9) reported in Tables [2] and [51 it is clear that the initial population 
impacts directly MASC's outcomes. This indicates that the performance of 
MASC could be further improved by using a more powerful coloring algorithm 
to generate the initial solutions of its population. 



4 Analysis of MASC 



In this section, we investigate the influence of two important ingredients of 
the proposed memetic algorithm, i.e., the multi-parent crossover operator and 
the combined neighborhood. Experiments were based on 16 selected graphs of 
different types, for which some reference algorithms cannot achieve the best 
known results. Hence, these selected instances can be considered to be difficult 
and representative. 



4-1 Influence of the Multi-parent Crossover Operator 



For our memetic algorithm, it is relevant to evaluate the effectiveness of its 
crossover operator. To verify this, we carry out experiments on the 16 selected 
graphs and run both MASC (using the MGPX crossover) and DNTS (without 
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Table 6 

Comparative results of MASC and DNTS 

Graph MASC DNTS 



Name 


£ 


£* 


Avg. 


S. 


Avg. 




anna 


276 


276 


276.0 


276 


276.0 


N 


queen6.6 


138 


138 


138.0 


138 


138.0 


N 


miles250 


325 


325 


325.0 


325 


325.0 


N 


miles500 


< 709 


705 


705.0 


705 


705.6 


Y 


DSJC125.1 


326 


326 


326.6 


326 


328.6 


Y 


DSJC125.5 


1012 


1012 


1020.0 


1016 


1029.8 


Y 


DSJC125.9 


2 503 


2 503 


2 508.0 


2 506 


2 530.1 


Y 


DSJC250.1 


973 


974 


990.5 


981 


997.7 


Y 


DSJC250.5 


3 219 


3 230 


3 253.7 


3 234 


3 301.7 


Y 


DSJC250.9 


< 8 286 


8 280 


8 322.7 


8 321 


8 381.9 


Y 


flat300.26.0 


3 966 


3 966 


3 966.0 


3 966 


3 966.0 


N 


flat300.28.0 


< 4 282 


4 238 


4 313.4 


4 303 


4 406.3 


Y 


le450_15c 


< 3 866 


3 491 


3 491.0 


3 491 


3 492.1 


Y 


le450.15d 


< 3 921 


3 506 


3 511.8 


3 506 


3 515.0 


Y 


le450.25c 


4515 


4 700 


4 773.3 


4 749 


4 803.9 


Y 


le450.25d 


4 544 


4 722 


4 805.7 


4 784 


4 835.3 


Y 



MGPX) for 30 times (with the same parameter pi, p 2 and p% settings as defined 
in Table [1]). The DNTS (without MGPX) starts with a single solution which 
is generated for MASC. DNTS stops when a maximum number of 5 x 10 5 
iterations in order to make sure that MASC and DNTS are given the same 
search effort. The results are given in Table EJ 

From Table El one notices that DNTS equals and improves respectively 5 and 
3 best known results while MASC equals and improves respectively 5 and 11 
best known results. Furthermore, the last column tt (t-test) indicates whether 
the observed difference between MASC and DNTS is statistically significant 
when a 95% confidence t-test is performed in terms of the best result obtained 
(£*). The t-test indicates that MASC is statistically better than DNTS for 
12 out of 16 cases except for the instances where DNTS can achieve the best 
known results (£). These comparative results provide clear evidences that the 
MGPX crossover operator plays an important role in the MASC algorithm. 



4-2 Influence of the Neighborhood Combination 



The neighborhood is an important element that influences the local search 
procedure. Our proposed algorithm relies on two different neighborhoods: Ni 
(neighborhood based on connected components) and N 2 (neighborhood based 
on one- vertex- move) which are explored in a token-ring way (see Section I2.4[) . 
In this section, we investigate the interest of this combined use of the two 
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neighborhoods. For this purpose, we carried out experiments on the 16 selected 
graphs to compare the original Double-Neighborhood Tabu Search (DNTS) 
with two variants which uses only one neighborhood Ni or N 2 . We use below 
TS^i and TSat 2 to denote these two variants. These three TS procedures 
(DNTS, TStvi and TSa^) are run under the same stop condition, i.e. limited 
to 5 x 10 5 iterations. 

We run 30 times these TS procedures to solve each of the 16 selected graphs 
and report the computational outcomes (the best and average results) in Table 
CD One easily observes that DNTS obtains better or equal results compared to 
TSati and TSjv2 for all the instances in terms of the best known result (£*) 
and the average result (Avg.). The t-test tti (i = 1, 2) in the last two columns 
confirms that with a 95% confidence level DNTS is slightly or significantly 
better than TSati and TSat2- This experiment demonstrates thus the advantage 
of the token-ring combination of the two neighborhoods compared to each 
individual neighborhood. 

Table 7 

Comparative results of the LS improvement method according to the neighborhood 

employed 



Graph 


DNTS 


T£ 


>iV2 


TSjvi 
S* Avg. 


tl 2 


If. 


E* 


Avg. 


E* 


Avg. 




anna 


276 


276.0 


282 


285.8 


276 


276.0 


Y 


N 


quccn6.6 


138 


138.0 


138 


138.4 


138 


138.0 


Y 


N 


miles250 


325 


325.0 


346 


361.6 


335 


340.7 


Y 


Y 


miles500 


705 


705.6 


722 


736.0 


719 


730.9 


Y 


Y 


DSJC125.1 


326 


328.6 


33 1 


340.8 


329 


334.0 


Y 


Y 


DSJC125.5 


1016 


1029.8 


1031 


1045.1 


1020 


1031.8 


Y 


N 


DSJC125.9 


2 506 


2 530.1 


2 514 


2 557.6 


2 512 


2 538.3 


Y 


N 


DSJC250.1 


981 


997.7 


1004 


1021.3 


1022 


1039.9 


Y 


Y 


DSJC250.5 


3 234 


3 301.7 


3 271 


3 323.9 


3 260 


3 306.5 


Y 


N 


DSJC250.9 


8 321 


8 381.9 


8 347 


8 405.6 


8 318 


8 387.5 


Y 


N 


flat300-26-0 


3 966 


3 966.0 


3 966 


3 966.0 


3 966 


3 966.0 


N 


N 


flat300-28.0 


4 303 


4 406.3 


4 347 


4 427.8 


4 332 


4 435.5 


N 


Y 


le450_15c 


3 491 


3 492.5 


3 503 


3 517.2 


3 508 


3 551.8 


Y 


Y 


le450.15d 


3 506 


3515.0 


3 528 


3 538.5 


3 526 


3 568.2 


Y 


Y 


le450.25c 


4 749 


4 803.9 


4 828 


4 893.9 


5 005 


5 067.4 


Y 


Y 


le450.25d 


4 784 


4 835.3 


4 848 


4 907.0 


5 035 


5119.1 


Y 


Y 



5 Conclusion 



In this paper, we presented a memetic algorithm (MASC) to deal with the 
minimum sum coloring problem (MSCP). The proposed algorithm employs 
an effective tabu search procedure with a combination of two neighborhoods, 
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a multi-parent crossover operator and a population updating mechanism to 
balance intensification and diversification. 

We assessed the performance of MASC on 77 well-known graphs from the 
DIMACS and COLOR 2002-2004competitions. MASC can improve 17 best 
known upper bounds including 11 large and very hard graphs with at least 
500 vertices while equaling 30 previous best results. We also report upper 
bounds for the 18 remaining graphs for the first time. Compared with five 
recent and effective algorithms which cover the best known results for the 
tested instances, our MASC algorithm remains quite competitive. 

Furthermore, we investigated two important components of the proposed algo- 
rithm. The experiments demonstrate the relevance of the multi-parent crossover 
operator and the combined neighborhood for the overall performance of MASC. 
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